REPRESENTATIVE COLOR DESIGNATING METHOD USING RELIABILITY 



BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to a representative color value designating 
method for an image search system, and in particular to a method for designating a 
representative color Of an image region by expressing a representative color value 
with respect to an image region together with a reliability which represents an 
accuracy of the representative color, and to a method for measuring a similarity of 
more than two images and a method for segmenting an image into similar regions 
using a feature of a representative color value expressed together with the reliability. 

2. Description of the Background Art 

In an image search technique, a color information used for an image search is 
an important factor in the characteristic of images. 

In a conventional art, there is a method in which an image is segmented into a 
nxm number of grids, and a color histogram is obtained with respect to each 
segmented cell, and a maximum value of the thusly obtained color histogram is 
determined as a representative color value with respect to a corresponding cell. In 
another method, an average value of the color histogram is determined as a 
representative color value of a corresponding cell. In another method, a major color 
vector is obtained and determined as a representative color value for a corresponding 
cell. 

However, since the characteristics of the images are various, it is difficult to 
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express an image using a color in an image region or one color value: It is improper to 
express a feature of an image by expressing the image region using one 
representative color value information. In this case, it is difficult to form an accurate 
database using the characteristics of images, and the performance of an image 
5 search using the thusly formed database is decreased. Furthermore, when expressing 
a representative color of an image region using various colors instead of one color, a 
large storing space is required. In addition, it is difficult to accurately express an 
interrelationship between various colors. Therefore, a representative color value of the 
thusly determined image region has a low accuracy. 
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SUMMARY OF THE INVENTION 

Accordingly, it is an object of the present invention to provide a method for 
designating a representative color which is expressed based on a reliability that a 
15 representative color of an image region expresses an image region. 

It is another object of the present invention to provide a method for expressing 
a color information of an image region using a reliability and a color segmentation 
method of an image region. 

It is still another object of the present invention to provide a representative color 
20 designating method which may be used for an image search based on a weight in 
accordance with a reliability. 

To achieve the above objects, there is provided a representative color 
designating method which comprises a step for expressing a reliability of the 
representative color value as a color information of the image region together with a 
25 representative color value which represents the image region in a method using a 



color value as an information with respect to an image region. 

Additional advantages, objects and features of the invention will become more 
apparent from the description which follows. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will become more fully understood from the detailed 
description given hereinbelow and the accompanying drawings which are given by 
way of illustration only, and thus are not limitative of the present invention, and 
wherein: 

Figure 1 is a flow chart of a representative color designating method using a 
reliability according to the present invention; 

Figure 2 is a flow chart of a method for obtaining a reliability using a color 
similarity according to the present invention; 

Figure 3 is a flow chart of a method for obtaining a color similarity according to 
the present invention; 

Figure 4 is a flow chart of a method for obtaining a reliability using a mixed rate 
and color similarity according to the present invention; 

Figure 5 is a flow chart of a method for obtaining a mixed rate according to the 
present invention; 

Figure 6 is a flow chart of a method for obtaining a frequency of a color pixel 
which has a chrominance exceeding a certain threshold value in an image region 
according to the present invention; 

Figures 7 and 8 are views illustrating an example of a method for searching a 
presence of a corresponding color by adapting an expansion mask to an image region 



for thereby obtaining a mixed rate according to the present invention; 

Figure 9 is a flow chart of a method for designating a representative color value 
using a reliability according to the present invention; 

Figure 10 is a flow chart of a method for designating a representative color 
value using a reliability in an image region according to the present invention; 

Figure 11 is a view illustrating a result(data structure) of a representative color 
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designation of an image region expressed together with a reliability according to the 
present invention; 

Figure 12 is a flow chart of a method for setting a representative color value 
and a reliability of each cell of a grid of an image region according to the present 
invention; 

Figure 13 is a flow chart of a method for obtaining a color similarity between 
two image grids with respect to two regions according to the present invention; 

Figure 14 is a view of a result of a representative color designation of an image 
region which is expressed by a reliability together with a representative color value 
having a certain degree reliability according to the present invention; and 

Figure 15 is a flow chart of a method for obtaining a similarity region in which 
an image region is properly segmented using a reliability according to the present 
invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention is directed to a method for designating a representative 
color of an image color based on a reliability that a representative color accurately 
expresses an image region when designating a representative color with respect to a 



certain image region. In addition, the present invention is directed to a method for 
determining a reliability in accordance with a mixed rate and color similarity of colors 
of an image region. 

In addition, the present invention is directed to a method for obtaining a 
similarity between images by comparing a representative color and reliability of each 
cell with respect to more than two image regions by obtaining a representative color 
and reliability with respect to each grid cell after segmenting an image region into 
multiple grids. 
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Furthermore, the present invention is directed to a color segmentation method 
for segmenting an image into regions having the same color in accordance with a 
reliability degree by expressing a representative color and reliability of an image 
region. 

The embodiments of the present invention will be explained with reference to 
the accompanying drawings. 

Figure 1 is a flow chart of a representative color designating method using a 
reliability which includes a step for obtaining a reliability of an image region, a step for 
setting the thusly obtained reliability with respect to the image region as a reliability of 
the above-described region, and a step for setting a representative color value of the 
image region together with the reliability. 

In the present invention, the reliability is an information representing an 
accuracy of a color value representing a certain region for an entire image or a certain 
portion within the image and is a value on whether a certain region expresses one 
color and is an accuracy when a corresponding region is expressed by the color and 
has a value between 0 and 1 . 

Therefore, assuming that the image region is formed of one color and the color 



is designated as a representative color of the region, the reliability of the 
representative color is 1 . While, if the image region consists of different clear colors 
and one color among the different clear colors is designated as a representative color, 
the reliability becomes 0. 

In addition, even when an image is formed of various colors, if the colors are 
properly mixed, the colors may be seen like one color. For example, blue colors and 
red colors are properly mixed in an image region, the thusly mixed colors may be seen 
like a purple colon Even when the colors are nor properly mixed, in this case, when an 
image is formed of similar colors, one color among the above-described colors may 
be designated as a representative color. When the thusly designated representative 
color may represent the image, the reliability with respect to the representative color is 
enhanced. For example, even when various yellow color groups are not properly 
mixed, a certain yellow color group may be designated as a representative color. 

Therefore, in the present invention, the reliability is set based on a value which 
is determined in accordance with the mixed rate and color similarity of the colors in the 
image region. The method for obtaining the reliability will be explained later with 
reference to Figures 2 through 8. When expressing the representative color value of 
the image region with the reliability, the representative color value may be used for 
searching the images based on the weights. In addition, it is possible to perform a 
color segmentation using the reliability. The description thereon will be provided later 
with reference to Figures 1 1 through 1 5. 

Two methods are disclosed for obtaining a reliability in the present invention. 
One method is directed to removing a mixed element based on an averaging process 
of the image region and obtaining a reliability in accordance with the color similarity. 
The other method is directed to obtaining an accurate value of the mixed rate and 



obtaining a reliability based on the color similarity. 

The first embodiment of the present invention for obtaining a reliability of the 
image region will be explained with reference to Figures 2 and 3. The mixed element 
is removed by the averaging process of the image region, and then the reliability is 
obtained based on the color similarity. 

In the embodiments of the present invention, the image region is assumed as a 
rectangular region. Otherwise, the above-described methods possibly be adapted by 
considering the boundary portion. 

The image region is changed to an image having a lower resolution. At this 
time, an average value of the nxn square pixel color values is obtained, and the nxn 
square pixels are changed to one pixel having an average color value, or the image 
region is filtered using the nxn average filter to obtain the same result. In the earlier 
method, errors occur, but the processing speed is fast. In the later method, the values 
are accurate but the processing speed is slow. 

When performing the averaging process, the number of colors existing in the 
image region is decreased after the averaging process, so that any effects of the 
mixed elements are removed. 

In the first embodiment of the present invention, the color similarity C-Sim is 
obtained after the averaging process is performed, and the thusly obtained value is 
set as a reliability value of the image region, and then the reliability is obtained. 

The method for obtaining the color similarity C-Sim will be explained with 
reference to Figure 3. 

First, an average color value is obtained with respect to all pixels of the image 
region. A hue(Hue_av), light(L_av), chrominance(Ch_av) are obtained with respect to 
the average color. In addition, all color pixels of the image region are changed to hue, 



light, chrominance elements, and then the average of the hue, light, chrominance 
elements is obtained. In this case, a result thereof is same. 

The hue, light, chrominance elements with respect to the average color of the 
image region are obtained, and then the color of each pixel is changed into hue(HJ), 
5 Nght(LJ), chrominance(Chj) elements with respect to each pixel Pi of all pixels, and 
the distance(hereinafter color difference) in a color coordinate space is obtained 
between the values (H_i, Lj, ChJ) and the average values (H_av, L_av, Ch_av), and 
the color differences are summed up to the last pixel. 

The thusly summed color difference becomes sum of all the color difference 
10 value between each pixel and an average color. The summed color difference value is 
normalized to 0 through 1, and a result value obtained by subtracting the normalized 
value from 1 becomes a color similarity C_Sim. 

In the first embodiment of the present invention, the thusly obtained color 
similarity value C-Sim is the reliability. Here, any color coordinate spaces which is 
15 used for obtaining the color similarity C-Sim may be available. As the color coordinate 
space is uniformly changed along with the human color perception, the value obtained 
based on the color coordinate space becomes a relatively accurate value. 

Next, the second embodiment of the present invention for obtaining a reliability 
will be explained with reference to Figures 4 through 6. In the second embodiment of 
20 the present invention, an accurate value of the mixed rate is obtained, and then the 
reliability is obtained based on the color similarity. 

Figure 4 is a view illustrating a method for obtaining a reliability based on a 
mixed rate Mix_Rate and a color similarity C_Sim. The reliability is represented as 
follows: 
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Reliability = Mix_Rate+(1-Mix_Rate)(C_Sim) — (1 ) 
where Mix_Rate is a value between 0 and 1 . 

Namely, the value of the mixed rate Mix_Rate becomes 1, the reliability of 
Equation 1 is determined by the Mix_Rate, and as the Mix_Rate becomes 0, the 
5 reliability of Equation 1 is determined by the color similarity C_Sim. In other words, as 
the mixed rate of the color in the image region is increased, it means that the colors 
are uniformly distributed, and the color of the region may be visually recognized as 
one color by human eyes. In this case, the reliability of the representative color value 
is largely affected by the mixed rate Mix_Rate, and as the mixed rate of the colors is 
10 decreased, the reliability of the representative color value is largely affected by the 
color similarity C_Sim. 

The color similarity C_Sim is obtained by the method as shown in Figure 3, and 
as shown in Figure 5, the mixed rate of the colors Mix_Rate is obtained using a ratio 
that each color occupies in the image region with respect to all colors of the image 
15 region and an expansion rate which represents that each color is mixed with other 
colors. 

The method for obtaining the mixed rate of the colors will be explained with 
refernece to Figure 5. 

The portion Ci that the pixel having each color Ci occupies in the image with 
20 respect to all colors in the image is obtained. For example, in the case of a red color, 
the portion(Red) = (the total number of pixels of the red color)/(the total number of the 
pixels in the image). Thereafter, the expansion rate Ci is obtained with respect to each 
color. Results obtained by multiplying two values with respect to all colors in the image 
are summed for thereby obtaining the mixed rate Mix_Rate of the colors as follows: 
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Namely, the mixed rate Mix_Rate = £ Portion(Ci) x Expansion_Rate(Ci) — (2) 

1=1 

where n represents the total number of colors in the image. 

The method for obtaining the expansion rate with respect to each color in the 
image region will be explained with refernece to Figures 7 and 8. The expansion rate 
Ci with respect to each color Ci is obtained as follows. 

Expansion_Ra'te(Ci)=Expansion(Ci)/Max_Expansion(Ci) 

where Max_Expansion(Ci) represents the maximum expansion value 
determined based on an esize and the image region as follows, and the esize 
represents a value which is in proportion to the size of the expansion mask. 

Max_Expansion(Ci)= ME(Ci); if Me(Ci)<the size of the image region 

Max_Expansion(Ci)=the size of the image region; if ME(Ci) >the size of the 
image region. 

ME(Ci)=(4esize 2 +4esize+1)x(the number of the pixels having the color Ci in 
the image region), where esize=(Width of Expansion__Mask-1)/2, and the 
width(=height) of the ExpansionJVIask is an odd number. 

The esize is a value proportional to the size of the expansion size and a value 
for obtaining the degree of the effect that a certain pixel influences. 
The Expansion(Ci) is obtained by the following sequence, 
(a) The esize is determined. Here, the esize is a value proportional to the size 
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of the Expansion_Mask(701 of Figure 7, and 801 of Figure 8) and represents a degree 
of a range that a certain pixel influences. 

(b) The number of the pixels having a corresponding color Ci in the image 
region is obtained. 

5 (c) The expansion_Mask is overlapped with respect to ail pixels in the image 

region, and it is searched whether or not corresponding color exists in the mask, and a 
mask center cell is a corresponding color as shown in Figures 7 and 8. If a 
corresponding color does not exist in the mask, and the mask center cell does not 
have a corresponding color, the expansion(Ci) value is increased by +1. For 

10 example, in the Fig. 8 in the case that the expansion is obtained with respect to the 
color representing as "C3", since the center cell of the mask is not the color "C3", and 
the color "C3" exists in the remaining mask regions except for the center cell of the 
mask, +1 is added to the Expansion(C3) value. 

(d) The above-descried operation is performed with respect to all image 

is regions, and the Expansion(Ci) obtained as a result of the above-described operation 
is added to the number of the pixels having a corresponding color for thereby finally 
setting the Expansion(Ci) value. 

Figure 7 is a view in which the Expansion_Mask 701 having the width and 
height of 5 and the esize of 2 is moved at every one pixel 703 in the image region, and 

20 figure 8 is a view in which the Expansion_Mask 801 is adapted to one pixel 803 in the 
image region 802. The numerals indicated in each pixel represent the color value of 
each pixel. 

When the Expansion_Rate, Mix-Rate, color similarity values are obtained, it is 
possible to obtain a reliability as shown in Figure 4. 
25 The method for designating a representative color using the thusly obtained 



reliability will be explained with reference to Figure 9. 

The reliability value obtained by the method as shown in Figures 2 through 8 is 
compared with a threshold value(hereinafter, called as a threshold value 1). As a 
result of the comparison, if the reliability value is larger than the threshold value 1, 
namely, if it is possible to express the image region using one representative value, 
the average of all color values of the image region is designated as a representative 
color value. 

However, if the reliability is smaller than the threshold value 1, designating the 
average color of the image region as a representative color of the region is inaccurate, 
another method is adapted. 

In the case that the reliability is smaller than the threshold value 1 , a frequency 
of the pixels in which the chrominance exceeds a certain level in the image region is 
obtained. The method for obtaining the frequency of the pixels which have a 
chrominance exceeding a certain degree is shown in Figure 6. As shown in Figure 6, 
a chrominance element is extracted from each pixel with respect to all pixels in the 
image region, and then the number of the pixels having a chrominance exceeding a 
certain level is obtained, and the number of the pixels is divided by the number of the 
pixels in all image regions for thereby obtaining a frequency(hereinafter called as a 
chrominance color portion) of the pixels having a chrominance exceeding a certain 
degree. As a result of comparing the chrominance color portion with a certain 
threshold value(hereinafter called as a threshold value 2), if the chrominance color 
portion is smaller than the threshold value 2, it means that a clear color which 
represents an image region does not exist. Therefore, the average color of the image 
region is designated as a representative color. 

As a result of the comparison, if the chrominance color portion is larger than the 
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threshold value 2, it means that a clear color which is a representative of the image 
region exists, the representative color is designated as follows. 

A hue element is extracted from the color of each pixel with respect to all pixels 
of the image region, and then is quantized for thereby forming a HUE histogram. The 
HUE histogram is formed by a descending series, and then the bin value is summed 
in the bin sequence having the larger values. The summing operation is performed 
until the summed value exceeds a certain threshold value(hereinafter called as a 
threshold value 3). When the summed result is larger than the threshold value 3, the 
color set corresponding to the summed bin is assumed as a HUE_SET, and an 
average of the pixel values in a corresponding image is obtained. The thusly obtained 
value is designated as a representative color. 

Figure 1 0 is a flow chart of a method for designating a representative color 
value using a reliability which is different from the embodiment of Figure 9. This 
method will be explained. If the reliability is smaller than the threshold value 3, a hue 
histogram is obtained, and the above-described process is performed with respect to 
all colors Ci. The hue(hi) of a certain color Ci is obtained, and the cases that the thusly 
obtained hue(hi) is larger is counted, and then the average value C av h of the color Ci 
is computed. The above-described operation is repeatedly performed until the final 
pixel in the image. When the final pixel is computed, in the case that there is not a 
hue(hi) value which is larger than a threshold value 4, namely, in the case that the 
count value is 0, the value obtained by averaging all colors in the image region is 
designated as a representative value. In the case that the count value is not 0, namely, 
if there is at least one hue(hi) value larger than the threshold value 4, the average 
value of the colors having a hue(hi) value larger than the threshold value 4 is 
designated as a representative color with respect to the region. 
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Figure 1 1 is a view illustrating a representative color expression method of a 
8x8 grid region formed of 64 local cells which are expressed by a reliability with 
respect to the representative color value in the image region. Namely, a color 
information is expressed based on a representative color value Cij and a reliability Sij 
5 of the local cell. 

Figure 12 us a view illustrating a sequence for segmenting an image region into 
grids and designating a representative color value with respect to each local cell. It is 
possible to implement a reliable image processing by segmenting an image region 
into local cells and expressing a reliability as well as a representative color which is 

10 expressed as a representative cell with respect to each local cell. 

Figure 13 is a view illustrating an adaptation of the method of Figure 12 and a 
comparison by segmenting the images G1 and G2 into grids as shown in Figure 11 
and expressing a representative color and reliability with respect to each local cell 
when comparing two images G1 and G2 having a nxm size. 

is Namely, the color similarities C_Sim(C1ij, C2ij) and reliability S1ij, S2ij of the 

local cells corresponding to each local cell of the images G1 and G2 are obtained, and 
the similarities RC_Sim(G1, G2) of two image regions G1, G2 are determined by 
multiplying the color similarity and reliability. Here, C1ij represents a representative 
color value with respect to the local cell (ij) of the image G1, and S1ij represents a 

20 reliability with respect to the representative color of the local cell (i,j). In addition, in the 
color similarities C_Sim(C1ij,C2ij), the local cell(ij) of the image G1 and the local 
cell(ij) of the image G2 may be expressed as a distance difference in the color 
coordinate space between C1ij and C2ij. Any type of color coordinate space may be 
used. As the color coordinate space is uniformly changed, the value obtained based 

25 on the color coordinate space becomes accurate. 



The similarities RC_Sim(G1, G2) between two image regions G1 and G2 
having a nxm size may be obtained based on a weight in accordance with a reliability 
value. The following is an example of the above-described method. 

5 RC_Sim(G1,G2)={^ £ [axS1ijxS2ijxC_Sim(C1iLC2ij>bx(HS1ij-S2ij)] 2 / 

i=l ;=1 

[(nxm)x(a+b)]} 

where a, b represent weights based on a reliability, and it is possible to obtain a 
similarity between two image regions by adjusting the values a and b. 
10 Next, the method that a color segmentation is performed for segmenting the 

region formed of the same colors using the reliability will be explained. 

It is possible to perform a color segmentation using the reliability by recognizing 
the case that the value of the reliability exceeds a certain level as the same color even 
when the colors are not the same, 
is Figure 15 illustrates the above-descried color segmentation method, and 

Figure 14 illustrates a quad tree for dividing the image into four parts. 

Namely, the reliability of the image region is obtained, and the image region in 
which the reliability is below a certain threshold value(hereinafter called as a threshold 
value 5) is segmented into four parts for thereby obtaining a representative color and 
20 reliability. 

The reliability of each of divided four region is compared with the threshold 
value 5, and the region having a threshold value below 5 is segmented into four parts. 
The above-described operation repeatedly performed until the reliability of all regions 
exceed 5. Therefore, in this case, since all segmented regions have a reliability of 
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above 5, the above-descried sub-regions may be recognized as one color. 

In other words, the entire images or a certain region designated by a user are 
expressed by a quad tree method, and each region of the quad tree is expressed as a 
representative color and reliability. The above-described quad tree type region 
5 segmentation is repeatedly performed until all regions have a threshold value above a 
certain degree. 

As described above, in the present invention, the representative color value of 
the image region is expressed together with the reliability, so that the weight is 
determined based on the reliability during the image search. When measuring the 

10 color similarity between two images, it is possible to accurately measure the color 
similarity using the reliability for thereby enhancing an image search performance. 

In addition, in the present invention, the representative color values of the 
image region are expressed together with the reliability, so that it is possible to more 
effectively perform a color segmentation in accordance with the degree of the 

15 reliability when performing a color segmentation in which the image region is 
segmented into sub-regions for thereby displaying the colors based on the same 
color. 

Although the preferred embodiment of the present invention have been 
disclosed for illustrative purposes, those skilled in the art will appreciate that various 
20 modifications, additions and substitutions are possible, without departing from the 
scope and spirit of the invention as recited in the accompanying claims. 
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